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5 

FIELD OF THE INVENTION 
The invention relates generally to signal decoding and, more particularly, to the 
decoding of signals that are encoded with lattice codes and/or multilevel coset codes. 

10 BACKGROUND OF THE INVENTION 

Maximum likelihood decoding represents an optimal solution for the decoding 
of signals encoded with multilevel coset codes and/or lattice codes. However, 
maximum likelihood decoding is not practical in many cases. For example, maximum 
likelihood decoding may not be practical when a code has a complex trellis. A 

1 5 complex trellis may exist, for example, when the number of constituent codes within a 
multilevel coset code or lattice code is large or when the minimal trellis of the 
constituent code(s) is large. Complex trellises are typically difficult to store (and draw) 
and, when maximum Ukelihood decoding is used, require a very large number of 
calculations to implement at the decoding stage. For this reason, decoding solutions are 

20 needed for multilevel coset codes and lattice codes that are less computationally 
complex than maximum likelihood decoding techniques. 

BRIEF DESCRIPTION OF THE DRAWINGS 
Fig. 1 is a block diagram illustrating a decoding system in accordance with an 
25 embodiment of the present invention; 

Fig. 2 is a diagram illustrating an iterative decoding unit in accordance with an 
embodiment of the present invention; 

Fig. 3 is a block diagram illustrating a decoding system that is adapted to 
perform turbo iterations in accordance with an embodiment of the present invention; 
30 and 
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Fig. 4 is a flowchart illustrating a method for decoding a signal in accordance 
with an embodiment of the present invention. 

DETAILED DESCRIPTION 
5 In the following detailed description, reference is made to the accompanying 

drawings that show, by way of illustration, specific embodiments in which the 
invention may be practiced. These embodiments are described in sufficient detail to 
enable those skilled in the art to practice the invention. It is to be understood that the 
various embodiments of the invention, although different, are not necessarily mutually 

10 exclusive. For example, a particular feature, structure, or characteristic described 
herein in connection with one embodiment may be implemented within other 
embodiments without departing from the spirit and scope of the invention. In addition, 
it is to be understood that the location or arrangement of individual elements within 
each disclosed embodiment may be modified without departing fi-om the spirit and 

15 scope of the invention. The following detailed description is, therefore, not to be taken 
in a limiting sense, and the scope of the present invention is defined only by the 
appended claims, appropriately interpreted, along with the fiill range of equivalents to 
which the claims are entitled. In the drawings, like numerals refer to the same or 
similar functionality throughout the several views. 

20 The present invention relates to methods and structures for decoding signals 

encoded with multilevel coset codes and/or lattice codes using iterative decoding 
techniques. The inventive techniques are significantly less computationally complex 
than optimal decoding solutions (e.g., maximum likelihood decoding) yet are capable 
of performance levels that approach those of the optimal methods. Because of the low 

25 complexity, the inventive techniques are especially valuable for use with codes having 
high dimensionality. In one embodiment, a data word received through a modulo 
lattice additive noise channel is treated as the sum of a multicode codeword and an 
interferer. The statistics of the interferer are used to determine prior probabilities 
associated with the multicode codeword. Iterative decoding techniques are then used to 

30 decode the individual constituent codes of the multicode codeword using the prior 
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probabilities. The iterative decoding process may include, for example, the exchange 
of information (e.g., extrinsic information) between a number of constituent decoders. 
After the multicode codeword has been decoded, a cell translation is determined and 
used to map the multicode codeword to an appropriate underlying lattice cell. As used 
5 herein, the term "multicode" refers to the set of codewords of a multilevel coset code 
(or lattice code) that are within the base cell of an underljdng lattice and the term 
"multicode codeword" will refer to a single codeword of the multicode. The inventive 
principles have application in communication systems and other systems using 
multilevel coset codes and/or lattice codes, 

10 A lattice must satisfy several rules; namely, it is closed under addition, it 

contains an inverse element for each lattice element, it contains the zero element (i.e., 
the origin of the coordinate axes is a point of the lattice), and it is discrete. Therefore, a 
lattice is a discrete infinite collection of points that is created by the repetition of a base 
or unit cell throughout space. A lattice code is a finite subset of a lattice. As such, a 

15 lattice code may be defined as the intersection of a lattice with a region of bounded 
support. A decoding rule that ignores the effect of a bounding region is referred to as 
lattice decoding. Other decoding rules exist that take the bounding region into account 
(e.g., minimum distance decoding). The inventive principles may be used in 
connection with both lattice decoding and minimum distance-like decoding techniques. 

20 Lattices can be constructed jfrom one or more individual codes in a number of 

different ways (see, e.g., "Sphere Packings, Lattices and Groups" by J. H. Conway et 
al., pages 137-156 and232-236. Springer- Verlag, New York, 1999). In one approach, 
for example, a point x=(xi, X2, Xn) is considered a lattice point if it is congruent 
modulo 2 to a codeword of a binary linear code C. Such a lattice will be referred to 

25 herein as a "construction A" lattice. A construction A lattice can be expressed 
mathematically as follows: 

A, =C + 2Z" 
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where C is a binary code of length n, n is the number of coordinates of each point of the 
lattice, and 2Z" is a lattice that translates the points of code C to form the lattice A„ (Z 
being the set of integers). As used herein, the lattice 2Z" will be referred to as the 
underlying lattice of lattice A„ . The codewords of code C each occur within a base 

5 cell (i.e., a cell that includes the origin) of the underlying lattice. A more general lattice 
construction, referred to herein as construction D, can be expressed as: 

A„ = C, +2C2 +4C3 +...+2*-'C^ +2*Z'' 

10 where constituent codes {C-}1^ are linear binary codes that are nested (i.e., a codeword 
of Ci is also a codeword of Cj+i), k is the number of constituent codes, and 2^Z" is the 
underlying lattice that translates the points of multicode (C, + 2C2 + 4C3 + ... + 2*"* Q ) 
to form the lattice A„ . As described previously, the codewords of the multicode 
(Q + 2C2 +4C3 +...+2*^^Q) occur within abase cell of the underlying lattice 2^Z". 

15 For a single constituent code, the construction D lattice reduces to the construction A 
lattice described above. The value of the translations in each of the above equations 
can be the same or different for each of the n coordinates. 

A coset code is a code of infinite codebook size that can be expressed as 
follows: 

20 

C = Co+(A,)« 

where A 3 Ai are lattices, [A/ AJ is a finite complete set of coset representatives of 
Ai in A , and Co c ([a / Aj J" is a code. The lattice (Aj )" in the above equation is the 

25 underlying lattice that translates the points of code Co to form the coset code C. A 
multilevel coset code is a code of infinite codebook size that can be written as: 

C = C,+C,+C3+... + C,+(A,,.)" 
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where A □ Aj 3 3 • • • 3 A^^i are lattices and Q c ([a^ / A^^i ])" , 
Q_j c ([Aj^_j /Aj^])", ... , and Cj c ([A/Aj])". The points of the multicode 
(Cj + C2 + C3 + ... + Q ) occur within the base cell of the underlying lattice (A^^^ )" . 
5 The underlying lattice (A^^^j)" translates the points of the multicode 
(Cj + C2 + C3 + ... + Q ) to form the multilevel coset code C. The lattice (A^^^ caa be 
replaced by a direct product A^^^j x A^^^^j x ... x A^^^j to create a time varying multilevel 

coset code. For A^^^j =2* Zand ^T'^C^ (where the C/j are nested linear binary 

codes), the multilevel coset code C is reduced to a construction D lattice. Thus, the 
10 construction D lattice is one form of multilevel coset code. Multilevel coset codes 
differ from construction D lattices in two primary areas: namely, (1) the nesting 
property of constituent codes of a construction D lattice is not required for a multilevel 
coset code, and (2) the constellation used by a multilevel coset code does not need to be 
one dimensional (i.e., A^^j need not be isomorphic to Z). In the discussion that follows, 

15 the inventive principles are most often described in general terms in the context of a 
multilevel coset code. It should be appreciated, however, that the inventive principles 
are equally applicable to construction A and construction D lattices as well as other 
lattice types. 

Fig. 1 is a block diagram illustrating a decoding system 10 in accordance with 
20 an embodiment of the present invention. The decoding system 10 receives an input 
word j? = (j^j , ) th^t has traveled through, for example, anoisy communication 

channel. Using the input word, the decoding system 10 must determine the 
corresponding codeword x = {x^,x^,...,x^) that was originally transmitted into the 

channel. The codeword x will be a valid codeword of a multilevel coset code being 
25 used within the system. The codeword x will include components from each of the 
constituent codes (c, , ) of the multilevel coset code as well as a translation term 

A that translates the word to an appropriate lattice cell. While propagating through the 
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channel, the codeword x is acted upon by an interference signal s =(s^,S2,^.',s^) that 

modifies the codeword in an additive manner. This process can be expressed as 
follows: 

5 y = J + r = (cj + ^2 + ... + + >i ) + 5 

where q € Q , C2 € • - j € Q , and A. e (A^^, )" . The interference signal s can 

include, for example, additive white Gaussian noise (AWGN) having a well known 
probability density function. By rearranging the terms in the above equation, the input 
10 word y can be expressed as follows: 

3; = (ci +C2 + ...H-c^) + (>l + J) = r + W 

where F = (Cj + + ... + ) is a multicode codeword and w =A-\-s is treated as an 

15 interferer. As will be described in greater detail, in one approach, the multicode 
codeword r is first decoded using an iterative decoding technique and the translation 
/L is then determined and used to map the multicode codeword r to an appropriate cell 
of the underlying lattice. 

As illustrated in Fig. 1, the decoding system 10 includes: a prior probability 

20 generator 12, an iterative decoding unit 14, a cell translation determination unit 16, and 
a cell mapping unit 1 8. It should be appreciated that the individual blocks illustrated in 
Fig. 1 are functional in nature and do not necessarily correspond to discrete hardware 
elements. For example, in one embodiment of the present invention, one or more (or 
all) of the functional blocks are implemented in software within one or more digital 

25 processing units (e.g., a general purpose microprocessor, a digital signal processor 
(DSP), a reduced instruction set computer (RISC), a complex instruction set computer 
(CISC), a field programmable gate array (FPGA), and/or others). Full or partial 
hardware implementations are also possible. 
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Using the input word y, the prior probability generator 12 generates 

probabilities for each of the constituent codes of the corresponding multilevel coset 
code. When the statistics of the interferer s are known (e.g., probability density 
function), these statistics may be used to determine the prior probabilities. As will be 
5 described later, techniques are also provided for determining the prior probabihties 
when the statistics of the interferer are not known. The iterative decoding unit 14 is 
operative for decoding the constituent code(s) of the multicode codeword r using 
iterative decoding techniques. The iterative decoding unit 14 uses the prior 
probabihties generated by the prior probability generator 12 to initialize the iterative 

10 process. The cell translation determination unit 16 determines the translation A of the 
codeword x based on the input word y and the multicode codeword r detenninedby 
the iterative decoding unit 14. The cell mapping unit 18 then maps the multicode 
codeword r to an appropriate lattice cell based on the translation A determined by the 
cell translation determination unit 16 to output the codeword 3c . 

15 In iterative decoding, there are typically two types of information conceming a 

bit of a codeword, information that depends on that bit's channel observation and 
information that depends on the channel observation of other bits that reflects to the 
subject bit due to the nature of the code. The latter type of information is referred to as 
"extrinsic information." 

20 In one embodiment of the present invention, the prior probabihty generator 12 

determines the probabilities that each coordinate of each constituent code has a 
predetermined binary value (e.g., zero) based on the content of the input word y and 

the statistics of the interferer s . In one such approach, a set S^""^ is first defined as the 
set of all symbols r whose wth coordinate in the binaiy representation is zero. For 
25 example,if r = cj+ 2C2G {0,1,2,3} then 8^^^= {0,2} and S<^^ = {0,1}. The set 5/'"^ is 

then defined as the set S^""^ that corresponds to the symbol at time instant i (i.e., r,). 

The prior probability that the ith time coordinate of the mth constituent code is zero is 
then given by: 
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It should be appreciated that the expression P(y+A,|r) refers to a probability function 
when the alphabet is discrete and a density function when the alphabet is continuous. 
5 For lattice decoding, when it is assumed that all translations are legal, the probability 
^(^/ h ^ ^) deemed a constant and the above equation reduces to: 

10 In one implementation, the above sxmmiations are truncated to include only the 

most significant terms. In the discussion above, the prior probabilities are expressed as 
conventional probabilities. It should be appreciated that the prior probabilities can be 
expressed in any of a number of alternative manners in accordance with the invention 
including, for example, likelihood ratios, log hkelihood ratios (LLRs), probabiUty 

15 differences, and other similar formats. 

In at least one embodiment of the present invention, the iterative decoding unit 
14 includes a separate decoder for each of the constituent codes of the multilevel coset 
code. Each of these constituent decoders will preferably be a soft in, soft out (SISO) 
decoder that accepts soft information at an input and uses it to generate soft information 

20 at an output that is indicative of the reliability of the decoder's decisions. Fig. 2 is a 
diagram illustrating an iterative decoding unit 28 that may be used in the system 10 of 
Fig. 1. As illustrated, the iterative decoding unit 28 includes first, second, and third 
constituent decoders 20, 22, 24 (DECODER 1, DECODER 2, and DECODER 3, 
respectively) that are each used to decode a corresponding one of the constituent codes 

25 of a multilevel coset code. Each of the constituent decoders 20, 22, 24 receives 
corresponding prior probabilities generated by the prior probability generator 12. The 
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constituent decoders 20, 22, 24 process this input information to generate, among other 
things, soft information at corresponding outputs. The constituent decoders 20, 22, 24 
then exchange soft information (e.g., extrinsic information) among each other and 
another round of processing is performed using the new information. Several or more 
5 rounds of such iterative processing will typically be performed to repeatedly refine and 
update the decisions of the individual decoders 20, 22, 24. In at least one embodiment, 
a predetermined number of iterations is performed. In another approach, the number of 
iterations is made dependent on the decoder outputs. Eventually, each of the 
constituent decoders 20, 22, 24 outputs a best estimate (either a soft or hard decision) of 
10 a corresponding portion of the output multicode codeword. An estimate of the 

multicode codeword (i.e., r ) is subsequently output from the iterative decoding unit 
28. 

The iterative decoding unit 28 may include any number of constituent decoders. 
The individual constituent decoders 20, 22, 24 of the iterative decoding unit 28 may 

15 also take many forms. For example, in at least one embodiment, one or more of the 
constituent decoders 20, 22, 24 is an iterative decoder itself Some iterative decoder 
types that can be used include, for example, turbo decoders and low density parity 
check (LDPC) decoders. For each iteration of the iterative decoding unit 28, an 
iterative constituent decoder can perform one or more of its own iterations. The 

20 iterative constituent decoder can then output, for example, posterior LLR's (or hard 
decisions) as well as extrinsic information for distribution to the other constituent 
decoders. Non-iterative constituent decoders can also be used (e.g., maximum a 
posteriori (MAP) decoders, forward-backward algorithm decoders, soft output Viterbi 
algorithm decoders, etc.). Non-iterative constituent decoders may also output posterior 

25 LLR's (or hard decisions) and extrinsic information for the other constituent decoders. 
The constituent decoders 20, 22, 24 can all be of the same type or different decoder 
types can be used. In one embodiment of the present invention, the information 
delivered to the mth constituent decoder (for the ith time coordinate) prior to a 
subsequent iteration includes the following probability: 

30 
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I P{y\r = rj)YlP{c^=D^{?7)) 
Pic"" = 0 JJ) = ^ -4-^- ^ 



where D^^ti) is the value of the codeword of the yth constituent code, c*, at the ith time 
coordinate, if ri is the value of the multicode, and P{d = a) is the posterior 
5 information received from the yth decoder. For the sake of brevity, dependence on i has 
been omitted in the above equation. 

Referring back to Fig. 1, when a multilevel coset code having only a single 
constituent code is used (e.g., a construction A lattice), the iterative decoding unit 14 
will typically include only a single iterative decoder. As can be appreciated, there is no 
1 0 exchange of information between constituent decoders in such an arrangement, merely 
p feedback of information from an output of a decoder to an input thereof 

S The cell translation determination unit 1 6 uses the multicode codeword estimate 

%! r output by the iterative decoding unit 14 and the input word y to determine the 

f " translation (e.g., /I e (A^^j ) " ) associated with the input word y . In one approach, the 

f^i 15 translation is found by determining argmax-^ P{A y,r). On some occasions, this 

m expression reduces to arg min j - (^ - r )|| . The cell mapping unit 1 8 subsequently 

maps the multicode codeword r to the appropriate lattice cell using the estimated 

translation A . The cell mapping unit 18 may output either hard or soft values. 

As an example of the operation of the decoding system 1 0 of Fig. 1 , assume that 

20 the number of coordinates of each lattice point of a code is 3 (i.e., n=3) and the number 
of constituent codes of the code is 2 (i.e., k=2). Also assume that the first constituent 
code Ci includes codewords (000) and (111) and the second constituent code C2 
includes codewords (000), (Oil), (101), and (110). Note that these example codes are 
for illustrative purposes only and may not represent actual codes (e.g., the codes are not 

25 nested). Further assume that the input word received from the channel is y =(5.6 7 -1). 

The lattice point x that needs to be determined is expressed as: 
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X = Cj + + 4Z 



The iterative decoding unit 14 decides that Cj = (1 1 1) and = (0 1 1). Thus, r = 

5 ([1+2(0)] [1+2(1)] [1+2(1)]) = (13 3). To determine the estimated translation i , it is 
first determined that (J; -^)- ([5.6-1] [7-3] [-1-3]) = (4.6 4 -4). This vector is then 
compared to the possible values of 4Z" and it is determined that the appropriate 
translation i is (4 4 -4) (i.e., argminj||/l -(jJ-r) p. The output x is thus 

determined to be P + X =([1+4] [3+4] [3-4]) = (5 7 -1). 
10 In at least one embodiment of the present invention, turbo iterations are 

performed. That is, instead of determining r and i once before generating the output 
word X , a nimiber of iterations are performed with each iteration further refming the 
previous one. Fig. 3 is a block diagram illustrating a decoding system 50 that is 
adapted to perform turbo iterations in accordance with an embodiment of the present 
15 invention. As shown, a feedback loop 54 has been added to feed back information 

relating to present values of i to an input of the iterative decoding unit 14 for use in 

generating updated versions of r and then X . As before, a predetermined number of 
iterations can be performed or the number of iterations can be output dependent. 

In the above description, it was assumed that the statistics of the interferer s 

20 were known. When no such statistical characterization of the interferer exists, 
however, other means for initializing the iterative process need to be developed. If a 
minimum EucUdean distance criterion is being used (i.e., the multilevel coset code 
point that is closest to y in Euclidean distance is sought), then a number of 
initiaUzation strategies are possible. In one approach, for example, it is assumed that 

25 the interferer has a Gaussian distribution with zero mean and unknown variance . 
The Gaussian distribution is an explicit function of Euclidean distance. In another 
approach, it is assumed that the interferer is uniformly distributed within a Voronoi cell 
of the underlying lattice. In an approximation of this approach, it can be assumed that 
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the Voronoi cell of A^^^j is a v-dimensional ball of radius R. In a high dimensionality 
lattice, this will typically be a good approximation. The volume of the ball is denoted 



Vv(R) and it is known that Vv(R)=R''xconstant. Therefore, P(s^ <a)^\ — 



and the 



probability density function of the interferer squared distance is given by (v - 1) — 

R 

5 If this approach is used, the log likelihood ratios are independent of the radius R. 
Therefore, the iterative algorithm does not need to know the value of R. As the exact 
value of R may be unknown, this is a very favorable result. 

Fig. 4 is a flowchart illustrating a method for decoding a signal in accordance 
with an embodiment of the present invention. Some or all of the method may be 

10 implemented and/or distributed as a software program stored on, for example, a 
computer readable medium (e.g., a compact disk read only memory (CDROM), floppy 
disk, tape, semiconductor memory, etc.). Similarly, some or all of the method may be 
implemented within an application specific integrated circuit (ASIC) or other digital 
circuit). First, an input signal is received that is encoded with a multilevel coset code 

15 (block 30). Prior probabilities are next determined using the input signal (block 32). 
Statistics associated with an interferer may also be used to determine the prior 
probabilities. In one approach, the statistics of the interferer are known. In another 
approach, statistics are assumed for the interferer. For example, as described above, it 
can be assumed that the interferer is uniformly distributed within a Voronoi cell that is 

20 an n-dimensional ball of radius R. Other techniques are also possible. 

Once the prior probabilities have been determined, they are used to initialize an 
iterative decoding process for the input signal to estimate a multicode codeword r 
(block 34). If multiple constituent codes are involved, the iterative decoding process 
may involve the exchange of information among individual constituent decoders during 

25 two or more iterative cycles. A translation estimate A is next determined for the input 
signal based on the resuU of the iterative decoding process (block 36). Optionally, the 
translation and estimated multicode codeword can be used to further refine the result of 
the iterative decoding process in one or more additional iterative cycles (block 38). 
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The translation is eventually used to map the result of the iterative decoding process to 

an appropriate cell of the underlying lattice (block 40). 

It should be appreciated that the principles of the present invention are not 

limited to use within communication systems. For example, any application that relies 
5 on vector quantization (e.g., speech or image compression) may benefit from the use of 

reduced complexity lattice decoders in accordance with the present invention. Other 

non-communications based applications are also possible. 

Although the present invention has been described in conjunction with certain 

embodiments, it is to be understood that modifications and variations may be resorted 
1 0 to without departing from the spirit and scope of the invention as those skilled in the art 

readily understand. Such modifications and variations are considered to be within the 

purview and scope of the invention and the appended claims. 
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